Realistic Face Animation for a Czech Talking Head

نویسندگان

  • Zdenek Krnoul
  • Milos Zelezný
چکیده

This paper is focused on improving visual Czech speech synthesis. Our aim was the design of a highly natural and realistic talking head with a realistic 3D face model, improved co-articulation, and a realistic model of inner articulatory organs (teeth, the tongue and the palate). Besides very good articulation our aim was also expression of the mimic and emotions of the talking head. The intelligibility was verified by the listening test and the results of this test were analysed. Firstly, the face model reconstruction from real data is presented. A 3D computer vision was employed in order to obtain a model of an arbitrary face. The stereovision technique that is used to reconstruct the model is described in detail in Section 2. Details concerning a visual speech synthesis are discussed in Section 3. Special features of the visual speech synthesis of the Czech language are mentioned, too. Furthermore, the design of a talking head including the solution of co-articulation problem is presented. Next, the modeling of expression and emotions in animation is described. The last part of the paper, Section 4, contains results of the performed listening test.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A development of Czech talking head

This paper presents a research on the Czech talking head system. It gives an overview of methods used for visual speech animation, parameterization of a human face and a tongue, necessary data sources and a synthesis method. A 3D animation model is used for a pseudo-muscular animation schema to create such animation of visual speech which is usable for a lipreading. An extension of animation sc...

متن کامل

Talking Head: Synthetic Video Facial Animation in MPEG-4

We present a system for facial modeling and animation that aims at the generation of photo-realistic models and performance driven animation. It is practical implementation of MPEG-4 compliant Synthetic Video Facial Animation pipeline (Simple and Calibration Profiles with some modifications), which includes: facial features recognition & tracking on real video sequence; obtaining, encoding, net...

متن کامل

Realistic facial animation system for interactive services

This paper presents the optimization of parameters of talking head for web-based applications with a talking head, such as Newsreader and E-commerce, in which the realistic talking head initiates a conversation with users. Our talking head system includes two parts: analysis and synthesis. The audiovisual analysis part creates a face model of a recorded human subject, which is composed of a per...

متن کامل

Viseme­aware Realistic 3d Face Modeling from Range Images

In this paper, we propose an example based realistic face modeling method with viseme control. The viseme describes the particular facial and oral positions and movements that occur alongside the voicing of phonemes. In facial animation such as speech animation and talking head, etc, a face model with open mouth is often used and the model is animated along with the speech sound by synchronizin...

متن کامل

FIX: Feature-based Image Transformations for Face Animation

This paper proposes a simple yet effective 2D image transformation method for face animation. Instead of using complicated 3D models or a large database of 2D images, a set of transformations are learned to create different visual effects in a given image, including talking, changing facial expressions, and head movement. This approach enables creation of realistic images with minimum input dat...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2004